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I. Introduction 

The performance of various hard decision algorithms for decoding low-density parity-check (LDPC) 
codes on the binary symmetric channel (BSC), has been studied in great detail. Gallager (U proposed 
two binary message passing algorithms, namely Gallager A and Gallager B algorithms. A code of length 
n is said to be (n, 7, p) regular if all the columns and all the rows of the parity-check matrix of the 
code have exactly 7 and p non-zero values, respectively. Gallager showed [1] that there exist (n,7,p), 
p > 7 > 3 regular LDPC codes, with column weight 7 and row weight p, for which the bit error 
probability approaches zero when we operate below the threshold (precise definition will be given in 
Section HVT) . Richardson and Urbanke (2) analyzed ensembles of codes under various message passing 
algorithms. They also described density evolution, a deterministic algorithm to compute thresholds. Bazzi 
et al. |3l determined exact thresholds for the Gallager A algorithm and outlined methods to analytically 
determine thresholds of more complex decoders. Zyablov and Pinsker [@]| were the first to analyze LDPC 
codes under the parallel bit flipping algorithm, and showed that almost all codes in the regular ensemble 
with 7 > 5 can correct a linear number of errors in the code length. Sipser and Spielman (5]| established 
similar results using expander graph based arguments. Burshtein and Miller [6] considered expansion 
arguments to show that message passing algorithms are also capable of correcting a linear number of 
errors in the code length. 

In this paper, we consider hard decision decoding of a fixed LDPC code on the BSC. The BSC serves a 
useful channel model in applications where there is no access to soft information and also where decoding 
speed is a major factor. The binary message passing algorithms, while allowing extremely fast hardware 
implementation, are not very attractive from the perspective of performance. More complex decoders such 
as the ones based on belief propagation exhibit superior performance but lead to slower decoders. The 
approach in this paper is to consider message passing decoders that have larger message alphabet (thereby 
providing performance improvement) as well as low complexity (thereby ensuring fast decoding). 

When an LDPC code is decoded by message passing algorithms, the frame error rate (FER) curve 
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has two regions: as the crossover probability a decreases, the slope of the FER curve first increases (the 
waterfall region), and then sharply decreases. This region of low slope for small a is called the error floor 
region. The problem of correcting a fixed number of errors assumes significance in the error floor region, 
where the slope of the FER curve is determined by the weight of the smallest error pattern uncorrectable 
by the decoder 0. 

For iterative decoding over the binary erasure channel (BEC), it is known that avoiding stopping sets 
(HI up to size t in the Tanner graph 10 of the code guarantees recovery from t or less erasures. A similar 
result for decoding over the BSC is still unknown. The problem of guaranteed error correction capability 
is known to be difficult and in this paper, we present a first step toward such result by investigating the 
conditions sufficient to guarantee the correction of three errors in column- weight-four codes. 

Column-weight-four codes are of special importance because, under a fixed rate constraint (which 
implies some fixed ratio of the left and right degrees), the performance of regular LDPC codes under 
iterative decoding typically improves when the right and left degrees decrease. Burshtein IfTOll showed 
that regular codes with 7 = 4, like codes with 7 > 5, are capable of correcting a fraction of errors under 
the parallel bit flipping algorithm. These results are perhaps the best (up to a constant factor) one can 
hope for in the asymptotic sense. The proofs are, however, not constructive and the arguments cannot be 
applied for codes of practical length. Chilappagari et al. [fTTT] have shown that for a given column weight, 
the number of variable nodes having expansion required by the bit flipping algorithm grows exponentially 
with the girth of the Tanner graph of the code. However, since girth grows only logarithmically with the 
code length, construction of high rate codes, with lengths in the order of couple of thousands, even with 
girth eight is difficult. 

Generally, increasing the number of correctable errors can be achieved by two methods: (a) by increasing 
the strength and complexity of a decoding algorithm or/and (b) by carefully designing the code, i.e., 
by avoiding certain harmful configurations in the Tanner graph. Powerful decoding algorithms such as 
belief propagation, can correct error patterns which are uncorrectable by simpler binary message passing 
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algorithms like the Gallager A/B algorithm. However, the analysis of such decoders is complicated due 
to the statistical dependence of messages in finite graphs. It also depends on implementation issues such 
as the numerical precision of messages. For Gallager B decoder, avoiding certain structures (known as 
trapping sets fT2|) in the Tanner graph has shown to guarantee the correction of three errors in column- 
weight-three codes lfT3l . and this paper is an extension of this result. 

In this paper, we apply a combination of the above methods to column-weight-four codes. Specifically, 
we make the following contributions: (a) We propose a class of message-passing decoders whose messages 
are represented by two bits. We refer to these decoders as to two-bit decoders, (b) For a specific two-bit 
decoder, we derive sufficient conditions for a code with Tanner graph of girth six to correct three errors. 

The idea of using message alphabets with more than two values for the BSC was first proposed by 
Richardson and Urbanke in Q. They proposed a decoder with erasures in the message alphabet. The 
messages in such a decoder hence have three possible values. They showed that such decoders exhibit 
thresholds close to the belief propagation algorithm. The class of two-bit decoders that we propose is a 
generalization of their idea, since we consider four possible values for the decoder messages. 

Since the main focus of the paper is to establish sufficient conditions for correction of three errors, we 
do not optimize the decoders, but instead choose a specific decoder. Also, for the sake of simplicity we 
only consider universal decoders, i.e., decoders which do not depend on the channel parameter a. 

The rest of the paper is organized as follows. In Section II, we establish the notation and define a general 
class of two-bit decoders. For a specific two-bit decoder, the sufficient conditions for correction of three 
errors are derived in Section III. In Section IV, we derive thresholds for various decoders. Simulation 
results in Section V illustrate that, for a given code, lower FER can be achieved by a two-bit decoder 
compared to the FER achieved by Gallager B algorithm. 

II. The class of two-bit decoders 

The Tanner graph of a code, whose parity-check matrix H has size m x n, is a bipartite graph with a 
set of n variable nodes and a set of m check nodes. Each variable node corresponds to a column of the 
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parity-check matrix, and each check node corresponds to a row. An edge connects a variable node to a 
check node if the corresponding element in the parity-check matrix is non-zero. A Tanner graph is said 
to be 7-left regular if all variable nodes have degree 7, p-right regular if all check nodes have degree p, 
and (n, 7, p) regular if there are n variable nodes, all variable nodes have degree 7 and all check nodes 
have degree p. 

Gallager type algorithms for decoding over the BSC run iteratively. Let r be a binary ?i-tuple input 
to the decoder. In the first half of each iteration, each variable node sends a message to its neighboring 
check nodes. The outgoing message along an edge depends on all the incoming messages except the one 
coming on that edge and possibly the received value. At the end of each iteration, a decision on the value 
of each bit is made in terms of all the messages going into the corresponding variable node. 

Let Uj(v,c) be the message that a variable node v sends to its neighboring check node c in the first 
half of the j th iteration. Analogously, vjj(c,v) denotes the message that a check node c sends to its 
neighboring variable node v in the second half of the j th iteration. Additionally, we define ujj(v, :) as the 
set of all messages from a variable v to all its neighboring checks at the beginning of the j th iteration. 
We define Uj(v, : \c) as the set of all messages that a variable node v sends at the beginning of the j th 
iteration to all its neighboring checks except c. The sets vjj(c, :) and Wj(c, : \v) are similarly defined. 

Remark: Since the message alphabet is finite, the message passing update rules can be described 
using a lookup table and hence only a finite number of two-bit decoders are possible. We assume two 
kinds of symmetry for the considered decoder. First, the Boolean function that represents any particular 
decoder must be symmetric in the sense that swapping all inputs must imply a swap of the output, i.e., 
the decoder performance does not depend on the sent codeword. Secondly, we consider only symmetric 
Boolean functions whose value depends only on the weight in the argument vector, not on positions of 
zeros and ones. Such symmetric Boolean functions are natural choice for regular codes. For irregular 
codes, asymmetric Boolean functions may lead to improved decoders, but this problem is out of the scope 
of this paper. In this paper, we focus on a class of two-bit decoders that can be described using simple 



algebraic rules and illustrate with an example how the lookup table can be constructed from the algebraic 
description. 

Let the message alphabet be denoted by M = {—S, —W, W, S} where — S denotes a strong "1", —W 
denotes a weak "1", W denotes a weak "0", S denotes a strong "0" and S, W E R + . It should be 
noted that this representation can be mapped onto the alphabet {11,01,00, 10}, but we use the symbols 
throughout for the sake of convenience. The received value r v E {0, 1} on the channel of a variable node 
v is mapped to Rv E {C,—C},C E M + , as follows: 1 — > — C and — > C. It can be seen that each 
message is associated with a value and strength (strength of a message is an indication of its reliability). 

Let Mi(u) denote the set of nodes connected to node u by an edge. Let the quantities tj(v, c) and tj(v), 
j > 1 be defined as follows: 



tj(v,c)— Wj-i(u, v) + Rv , tj(v) — 22 ^j( u , v ) + Rv (1) 

u£Afi{v)\c uSA/i(u) 



Additionally, let 



sign(zuj(c,vj) = sign(u}j(u,c)), 

ueAfi(c)\v 



where sign(a) — 1, if a > and sign(a) = — 1, if a < 0. 

The message passing update and decision rules can be expressed as follows. The absolute value is 
denoted by | ■ |. 

S ■ sign(wj(c,v)), if \/u E Ni(c)\v, 



loi(v, c) = W ■ sign(Rv) , wAc, v) = < 



\uJj{u, c)| = S 



W ■ sign(vjj(c, v)), otherwise 
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For j > 1: 



cUj(v, c) = < 



W • sign(tj(v, c)), if < \tj(v, c)\ < S 



S ■ sign(tj(v, c)), if c)| > S 



W ■ sign(R v ), if tj(v, c) = 



Decision: At the end of j <h iteration, the estimate r 3 v of a variable node v is given by 



0, if > 



« = •{ 1, if tj(v) < 
r„, if tj(v) = 

The class of two-bit decoders described above can be interpreted as a voting scheme in the following 
way: every message has two components, namely the value (0 or 1) and the strength (weak or strong). 
The sign of the message determines the value, whereas the values of W and S denote the number of 
votes. The received value is associated with C votes. To compute the outgoing message on the variable 
node side, the total number of votes corresponding to and 1 are summed. The value of the outgoing 
message is the bit with more number of votes and the strength is determined by the number of votes. In 
the case of a tie, the outgoing message is set to the received value with a weak strength. Table U gives 
an example of message update for a column-weight-four code, when C = 2, S = 2 and W — 1. The 
message ujj(v, c) goes out of variable node v, and is computed in terms of the three messages going into 
v from the neighboring check nodes different of c. Table [TIT] shows the message passing update rules for 
(C, S, W) = (2, 2, 1). Table IE shows the decision rules for (C, S, W) = (2, 2, 1). 

Different decoders in this class can be obtained by varying the values of S, W and C. Hence, we 
denote a particular decoder by the triplet (C,S,W). Since there are only a finite number of two-bit 
decoders, different choices for C, S and W might lead to the same decoder. Let C denote the class of 
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above algebraically described decoders. Let us consider the set of all possible two-bit decoders which are 
symmetric in the senses that the performance is the same for any codeword, and whose Boolean functions 
do not depend on the location of and 1 in the entries, but only on the weight. Let S denote such a set of 
rules. Then the following question arises: is this set S encompassed in CI We do not intend to formally 
address this question, but rather give a discussion. 

The answer is obviously no. However, among all these rules in S, only a few are decoders, in the sense 
that if no error occurred, the sent codeword is output. Among these latter rules, only a few are further 
capable of correcting errors. We define the quality of a given rule by its threshold of convergence a*, 
which is the maximum crossover probability of the BSC for which it is possible to achieve an arbitrary 
small error probability under iterative decoding, as the codeword length tends to infinity. Thresholds of 
two-bit decoders are further discussed in Section JVJ In order to verify that the rules in C allow to reach 
the best possible thresholds achievable with general two-bit decoders, we empirically checked that for 
any rule in S\C with better threshold than a rule in C with reasonable threshold, there exists a rule in 
C which has an at least as good threshold. Hence, we did an exhaustive scan of possible rules, for two 
(d v ,d c ) regular code ensembles: (3,4) and (4,5), where d v and d c are the connection degrees of variable 
and check nodes, respectively. It is observed that for the (4, 5) regular code ensemble, no rule in S\C has 
better threshold than any rule in C. For the (3, 4) regular code ensemble, only two rules in S\C have better 
threshold than any rule in C, but with a very slight difference (0.078 for the former versus 0.075 for the 
latter). Thus, it is reasonable to assume the class C of algebraically described decoders are representative 
of the best possible two-bit decoders. 

In the next section, we focus on the two-bit decoder with (C, S, W) = (2,2,1), and provide the 
conditions on the Tanner graph of the code to correct all patterns with up to three errors. As shown in 
Section [IV] this decoder has better thresholds than one-bit decoders for various code rates. 
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III. Guaranteed weight-three error correction 

In this section, we first find sufficient conditions on the Tanner graph of a code to ensure that the 
code can correct up to three errors in the codeword, when the decoding is performed with the two-bit 
decoder with (C, S, W) = (2,2, 1). As justified in the introduction, we consider only left-regular codes 
with column weight four. 

Since the code is linear and the channel and the decoder are symmetric, we can assume, without loss of 
generality, that the all-zero codeword is transmitted over the BSC. We make this assumption throughout 
the paper. Hence, the variable nodes flipped by the channel are received as "1". 

The problem of guaranteed error correction capability assumes significance in the error floor region. 
Roughly speaking, error floor is the abrupt degradation in the FER performance in the high SNR regime. 
The error floor phenomenon has been attributed to the presence of a few harmful configurations in the 
Tanner graph of the code, variously known as stopping sets (for the BEC), near codewords Ifl4ll . trapping 
sets (for iterative decoding on the BSC and the AWGN) and pseudo-codewords (for linear programming 
decoding) |fl"5l . While girth optimized codes have been known to perform well in general, the code length 
and the degree distribution place a fundamental limit on the best achievable girth. Hence, additional 
constraints on the Tanner graph are required to ensure better error floor performance. 

The guaranteed error correction capability of column-weight-three LDPC codes under the Gallager A 
algorithm is now completely understood (see lfT6ll . ifTTll for details). For column-weight-four LDPC codes 
under the Gallager B algorithm, sufficient conditions to guarantee the correction of all error patterns 
with up to three errors have been derived by Chilappagari et a/. lfT8l . The conditions derived in lfT8l 
impose constraints on the least number of neighboring check nodes for a given set of variable nodes. The 
conditions that we derive are similar, but impose fewer constraints on the Tanner graph, thereby resulting 
in codes with higher rates for the same length. A short discussion on this issue is provided at the end of 
the section. 

Let us first give some additional definition and notation. 
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Definition 1: The neighborhood of depth one of a node u is denoted by N\(u) and is composed of 
all the nodes such that there exists an edge between these nodes and u. Similarly, ftfd(u) denotes the 
neighborhood of depth d of node u and is composed of all the nodes such that there exists a path of 
length d between these nodes and u. 

Let E be a set of nodes, say E = Uj-Uj, then the depth d neighborhood of E is Afd(E) = \JiMd{ui). 

Now we state the main theorem. 

Theorem 1: [Irregular expansion theorem] Let Q be the Tanner graph of a column- weight-four LDPC 
code with no 4-cycles, satisfying the following expansion conditions: each variable subset of size 4 has 
at least 11 neighbors, each one of size 5 at least 12 neighbors, each one of size 6 at least 14 neighbors, 
each one of size 8 at least 16 neighbors and each one of size 9 at least 18 neighbors. The two-bit decoder, 
with C = 2, S = 2 and W — 1, can correct up to three errors in the codeword within three iterations, if 
and only if the above conditions are satisfied. 

For ease in notation, each expansion condition will be denoted by "4— >11 expansion condition", "5 — ^12 
expansion condition" and so on. 
Proof of sufficiency: 

Remark: The proof can be followed more easily by looking at Tables |II] and [IIT1 Let V 1 = {v\,v\,v\} 

and C 1 = Miy 1 ). For more easily readable notation, let M 2 {y l )\V l be denoted by V 2 and A^ L (V /2 )\C 1 

by C 2 . Also, we say that a variable node is of type when it has p connections to C 1 and q connection 

to C 2 . The union of order d neighborhoods of all the T£ variable nodes is denoted by Nd{T^). 

We consider all the subgraphs induced by three erroneous variable nodes in a graph and prove that, in 

each case, the errors are corrected. The possible subgraphs are shown in Figure [Q As shown, five cases 

arise. In the reminder, we assume that the all-zero codeword has been sent. We provide the proof for Case 

4 and relegate the proofs for necessity and other cases to the Appendix. 

Case 4: Consider the error configuration shown in Figure Ed). In the second half of the first iteration 
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we have: 

w^c-.XV 1 ) = -W , c&C l \{c\,$} 
w\{c,v) = -W , v {c\ : c\} 
wi(c,v) = W , otherwise 

Let us analyze the second iteration. For any v G V\V l and c G C 1 , ^(f, c) can never be — S because no 
—S messages propagate in the first iteration. So, for any v G VXV 1 and c G C 1 , o>2(v,c) = — W if and 
only if wi(\ \c,v) = —W, which implies that v must have four connections to C 1 . This is not possible 
as it would cause a 4-cycle. Hence: 



UJ2\U2 J u / 


— -S 






W 2 («2,C4) 


= -W 






^2(^2:4) 


= 








= -W 






\ c 7) 


= -w 






w 2 (u,c) 


= -W 




ce^njVifr' 


^2(^1,04) 


= W 






^2(^3, 4) 


= W 






w 2 (w,c) 


= W v 


G A/o(T 2 2 ), 


cGC 2 nM(7|) 


w 2 (w,c) 


= W v 


e ■M)(r 3 1 ), 


c g c 1 n Mi(T^) 


w 2 (w,c) 


= s , 


otherwise 





In the first half of the third iteration, we have 

W3(«|,:) = W 



Lemma 1: All variables in V are corrected at the end of the third iteration because, for any v E V , 

Ct7 3 (:, v) = W or S. 

Proof: The proof is by contradiction. Let us assume that there exists a variable in VXV 1 , say v, such that 
there exists c E C 1 and uj s (v,c) = —W or u 3 (v,c) = —S. Since it is impossible that two — S messages 
go into v, as it would cause a 4-cycle, uj-^v, c) = —W or us(v, c) = —S implies that v receives from its 
neighbors different of c, at the end of the second iteration, three — W messages, or one —S and two — W 
(see Table ED- 

• If v receives three — W: As proved previously, v cannot have four neighbors in C 1 . Hence, v must be 
connected to c\ E C 2 such that K7 2 (c^, v) = —W. With the above described values of the messages 
in the second half of the second iteration, we see that c\ must be connected to a T\ variable in V 2 , 
say x\. Let notice that there cannot be more than two T 3 X variables in V 2 , otherwise six variables 
would be connected to only thirteen checks. We are interested in v which has at least one connection 
to C 1 . v has at most three connections to C 1 . Three cases arise: 

- If v has three connections to C 1 , then v must have one neighboring check in C 2 , say cf, which has 
at least one neighboring variable, say v', in Ao(T 3 1 ) different of v. Then the set {v\, v\, vl,v, v'} 
has only eleven neighbors, therefore contradicting the 5 — ^ 12 expansion condition. 

- If v has at two connections to C 1 , then v has two neighboring checks in C 2 , say c\ and c 2 , 
which must have each at least one neighboring variable, say v' and v", in Ao(T 3 1 ) different of v. 
Then the set {v\, v\, v, v', v"} has only twelve neighbors, therefore contradicting the 6 — > 14 
expansion condition. 

- If v has at only one connection to C 1 , then v must have three neighboring checks in C 2 , each 
of them connected to a T% variable. This has been previously proved to be impossible. 

• If v receives two — W messages and one —S message: 

- If v has at three connections to C 1 , then we end up in the same situation as in the first item, 
where the 5 — ^ 12 expansion condition is not satisfied. 
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- If v has at two connections to C 1 (one to {c\,c\} to receive a — S message, the other one to 
propagate a — W or — S message to C 1 ), then we end up in the same situation as in the first 
item, where the 6 — > 14 expansion condition is not satisfied. 
Hence, v\,v\ and v\ are corrected at the end of the third iteration. 

■ 

Lemma 2: No variable in V\V l can propagate — W at the beginning of the third iteration, except 
variables of type T$, and T 2 variables which have a common check node in C 2 with a T 3 X variable. 
Proof: 

• Consider a variable v which has two connections to C 1 . For this variable v to propagate —W at the 
beginning of the third iteration, it is necessary to receive a —S or —W message from one of its two 
check nodes in C 2 , which is the case only if it shares a check node in C 2 with a Tg 1 variable. 

• Consider a variable v which has exactly one connection to C 1 . For this variable v to propagate — W 
at the beginning of the third iteration, it is necessary to receive a — S or — W message from two of 
its three check nodes in C 2 , say c\ and c|, which is the case only if c\ and c 2 , are both shared by T% 
variables, say v\ and v\. Then the set {v\, v\, v\, v 2 , v\ , v} is connected to only 12 checks, therefore 
contradicting the 6 — ► 14 expansion condition. 

• Consider a variable v which has no connection to C l . For this variable v to propagate —W at the 
beginning of the third iteration, it is necessary to receive a —S or — W message from three of its 
four check nodes in C 2 . This implies the existence of three Tg 1 variables, which has already been 
proved to be impossible. 

■ 

Lemma 3: Any variable in VXV 1 is correctly decoded at the end of the third iteration. 
Remark: That is to say that any variable in VXV 1 is decoded to its received value since it is not received 
in error by hypothesis. Proof: According to Table |inj no message —S propagates in the third iteration 
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since all variables in V 1 receive at least three W messages at the end of the second iteration, and variables 
in VXV 1 cannot receive more than one —S message. In that case, to be decoded as a one, a bit whose 
received value is zero has to receive only — W messages according to the decision rule (see Table HU). 
That is for any v E VXV 1 , v is wrongly decoded if and only if w s (:,v) = —W. Let E denote the set of 
T 2 variables which share a check in C 2 with a T 3 variable. 

Firstly, let consider a variable in E, say v, and let us call v' the T 3 variable with which v shares a check 
node in C 2 . There cannot exist in the graph, at the same time, v and a T 3 variable, say v", different of 
v'. If such variables would exist, v, v', v" and the variables in V 1 would be connected to only 13 check 
nodes, therefore contradicting the 6 — > 14 expansion condition. Secondly, no v E V\V X can have more 
than two neighboring checks in {c\, d,, c 3 , Cg, c\, cj }, otherwise it would introduce a 4-cycle. Hence, only 
de following cases are possible for a variable v not in V 1 to receive four wrong messages: 

• If v has no connection to E, two cases arise: 

- If v has two connections in {c\, c\, c 3 , c\, Cg, c\ } and two connections to Af^T^) fl C 2 . Then v, 
the variables in V 1 and the two T 3 X variables are connected to only 12 check nodes, therefore 
contradicting the 6 — ► 14 expansion condition. 

- If v has at most one connection to {c\, c\, c 3 , c|, Cg, c\ }, it must have at least three connections 
to A/i(T 3 ) fl C 2 . However, there cannot exist three T 3 variables as it would imply that the set 
made of these three variables and V 1 would be connected to only 13 check nodes, therefore 
contradicting the 6 — ► 14 expansion condition. 

• If v has no connection to A/i(T 3 ) fl C 2 , two cases arise: 

- If v has two connections in {c\, c\, c\, c\, c\, c\ } and two connections to E. Let consider one of 
the two variables in T|, say v', the T 3 variable with which v' shares a check node in C 2 , v and 
the variables in V 1 . Then this set of variables is connected only to 13 check nodes, therefore 
contradicting the 6 — » 14 expansion condition. 

- If v has at most one connection to {c\, c\, c 3 , Cg, Cg, c\ }, it must have at least three connections 
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to E. This implies the existence of three distinct T 3 X variables, which is impossible, as above 
mentioned. 

■ 

Thus, the decoder converges to the valid codeword at the end of the third iteration. 
Note that similar conditions for a column-weight-four LDPC code of girth six to correct any weight-three 
error pattern within four iterations, when it is decoded with Gallager B algorithm, has been found by 
Chilappagari et al. lfT8l . The conditions are that each variable subset of size 4 has at least 11 neighbors, 
each one of size 5 at least 12 neighbors, each one of size 6 at least 14 neighbors, each one of size 7 at 
least 16 neighbors and each one of size 8 at least 18 neighbors. These conditions are stronger than the 
ones of Theorem Q] in two aspects, on which we wish to have a short discussion. 

On one hand, provided that the respective graph conditions are fulfilled, the number of required iterations 
to correct three errors is lower for the (2, 2, 1) two-bit decoder than for the Gallager B decoder. However, 
since messages are quantified over two bits for the former and over one bit for the latter, a lower number of 
iterations does not necessarily mean a lower decoding complexity. We do not provide here further analysis 
for comparison of decoding complexity between both kinds of decoding, as it would highly depend on 
hardware choices. 

On the other hand, the higher the rate of the code, the more difficult for the Tanner graph of the code 
to satisfy the expansion conditions, since the variable nodes tend to be less and less connected when the 
code rate increases. Hence, it is likely that weaker expansion conditions, obtained for the two-bit decoder, 
make possible the construction of higher rate codes, with weight-three error correction capability, than 
expansion conditions required by the one-bit Gallager B decoder do. However, determining analytically 
the highest achievable rate for a given set of expansion conditions is a problem which may be very hard 
to solve, and which is out of the scope of this paper. 



16 

IV. Asymptotic analysis 

This section intends to illustrate the interest of two-bit decoders over one-bit decoders, in terms of 
decoding thresholds. In particular, we show that the two-bit decoder, for which expansion conditions for 
weight-three-error correction has been derived, has better thresholds than one-bit decoders, for various 
code rates. 

A. Density evolution 

P{W 3 = X} = K 1 P{R = r} P{Wj-i = Y} n( - Y )p{Wj-i = -S} n{ ~ s) (2) 

re{-C,C},n(W),n(S),n(-W): YeM\{-S} 
f(T,r)=X 

P{Wj = X} = Yl K p II p { W i = Y} n{Y) P{W, = -S} n( - S) (3) 

n(W),n(S),n(-W): YeM\{-S] 
g{n{-S),n{-W),n{W))=X 

Asymptotically in the codeword length, LDPC codes exhibit a threshold phenomenon Ifl9l . In other 
words, for a smaller than a certain threshold, it is possible to achieve an arbitrarily small bit error 
probability under iterative decoding, as the codeword length tends to infinity. On the contrary, for noise 
level larger than the threshold, the bit error probability is always larger than a strictly positive constant, 
for any codeword length Ifl9l , [0. 

In B2l and lfT9l , Richardson and Urbanke presented a general method for predicting asymptotic per- 
formance of binary LDPC codes. They proved a so-called concentration theorem [0 according to which 
decoding performance over any random graph converges, as the code length tends to infinity, to the 
performance when the graph is cycle-free. Thus, relevant evaluation of performance of binary LDPC 
codes is possible in the limit case of infinite codeword lengths. The proposed density-evolution method 
consists in following the evolution of probability densities of messages along the decoding iterations. The 

messages in each direction are assumed to be independent and identically distributed. 

For the class of two-bit decoders, we derive thresholds for different values of C and S. The code 
is assumed to be regular with column weight 7 and row degree p. The numbers of W, S and — W 
messages are denoted by n{W), n(S) and n(—W), respectively. In the sets of equations © and ©, 

n(W) e [0, . . . , d], n(S) E [0, . . . , d-n(W)], n(-W) E [0, d-n(W) -n(S)), where d is either 7 or 
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p, depending on the context. The number of —S messages n(—S) is hence d — l—n(W) — n(S) — n(— W), 
with d = 7 or p depending on the context. Since the messages of the graph, in each direction, are assumed 
to be independent and identically distributed, Wj (resp. Wj) denote the random variables distributed as 



(v, c) (resp. Wj(c, v)) for any pair c) of connected variable and check nodes. X denotes an element 



of the message alphabet M. Also, R E {— C, C} denotes the random variable which corresponds to the 
channem messages. The density evolution equations are given by the sets of equations © and ©, where: 



YEM 



K P = 



7- 1\ h- 1 - n(W)\ h-l- n(W) - n(S) 
n(W))\ n(S) )\ n(-W) 
p - 1\ (p - 1 - n(W)\ fp-1- n{W) - n{S) 
n{W))\ n(S) )\ n{-W) 



The two functions / and g are defined as follows: 



/:Z 2 



M 



W-sign(T + r), if < |T + r| < S" 



f( T > r ) = { S-signiT + r), if \T + r\ > S 



W ■ sign(r) 



if T + r = 



g:N 3 



M 



7(ni,n 2 ,n 3 ) = 

W, if n 3 + n 2 > 0, n 2 + Hi = mod (2) 

S, if ri3 + n 2 = 0, n 2 + Hi = mod (2) 



-W, if n 3 +n 2 > 0, n 2 + m = 1 mod (2) 



— S", if n.3 + U2 = 0, n 2 + rii = 1 mod (2) 
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B. Thresholds of two-bit decoders 

Table HVl encompasses thresholds for various code parameters and decoding rules. Thresholds are given 
in probability of crossover on the BSC. Algorithm E is presented in 0. For the two-bit decoders, the set 
(C,S,W) is given. When the threshold is below 0.001, x is put in the box. The code rate is defined by 
1 — 2. Table [IV] shows that the specific two-bit decoder with parameters (C, S, W) = (2, 2, 1), has better 
thresholds than one-bit decoders Gallager A and B algorithms. However, this decoder has not the best 
threshold among the two-bit decoders. Indeed, we tried to achieve a trade-off between good thresholds 
and not too strong conditions for three error correction. Nevertheless, the method of analysis applied in 
the proof of the previous section is general, and can be applied to a variety of decoders to obtain similar 
results. 

Remark: Algorithm E and the presented dynamic two-bit decoder outperform the other ones, especially 
for code rates | (i.e., p = 16) and | (i.e., p = 32). Algorithm E, described in 0, is the aforementioned 
decoder with erasures in the message alphabet. At each iteration, the weight affected to the channel 
observation (equivalent to C in the two-bit decoder) is optimized [0. The dynamic two-bit decoder is 
based on the same idea: for S = 2 and W — 1, C is chosen at each iteration. The better thresholds of the 
presented dynamic two-bit decoder over Algorithm E indicates that it is interesting to consider decoding 
on a higher number of bits, even if the channel observation is still one bit, to get better thresholds. 

V. Numerical results 

We have formally proved the capability of weight-three-error correction of an LDPC code satisfying 
conditions of Theorem Q] and decoded with the two-bit decoder with (C, S, W) = (2, 2, 1). To compare 
this two-bit decoder with another one-bit decoder, namely Gallager B, we have plotted FER in Figure [2] 
We consider a Mac Kay code, with column weight four, 1998 variable nodes and 999 check nodes. The 
code rate is 0.89. This code has been decoded with Gallager B and the above two-bit decoder. Figure [2] 
shows that the two-bit decoder has lower FER than Gallager B decoder. In particular, we observe better 
waterfall performance using the two-bit decoder, and about ldB gain in the error- floor. 
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VI. Conclusion 

In this paper, we proposed a class of two-bit decoders. We have focused on a specific two-bit decoder 
for which we have derived necessary and sufficient conditions for a code with Tanner graph of girth six 
to correct any three errors within three iterations. These conditions are weaker than the conditions for a 
code to correct three errors when it is decoded with Gallager B algorithm, which uses only one bit. We 
have computed thresholds for various two-bit decoders, and shown that the decoder for which the previous 
conditions has been derived has better thresholds than one-bit decoders, like Gallager A and B. Finally, 
we have compared the frame error rate performance of the two-bit decoder and Gallager B algorithm for 
decoding a column-weight-four code with high rate. The two-bit decoder performs better than Gallager 
B both in the waterfall and in the error-floor region. This illustrates that it is interesting to use two bits 
rather than one bit for decoding. 

Future work includes extending the analysis to derive sufficient conditions to guarantee correction of 
higher number of errors, as well as investigating on general expression of conditions in terms of the number 
of quantization bits for the messages. While the focus of the paper was on left-regular LDPC codes, the 
general methodology and the approach presented in the paper are applicable to irregular LDPC codes 
also. The analysis in the case of irregular codes will be more complex, but given that carefully designed 
irregular LDPC codes outperform their regular counterparts, the study of guaranteed error correction under 
different decoders for such codes is a problem worth investigating. 
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Appendix 

In this Appendix, we provide the proofs for Cases 1, 3, 4 and 5 as well as prove the necessity of the 
conditions stated in Theorem 1. 

Case 1: Consider the error configuration shown in Figure QI a). In this case, variables 1, 2 and 3 send 
incorrect — W messages to their neighbors in the first iteration. They receive W messages from all their 
neighboring check nodes, they are therefore decoded correctly at the end of first iteration. Error occurs 
only if there exists a variable node with correct received value that receives four — W messages from its 
neighboring check nodes (see Table HU). However, since variables 1, 2 and 3 are the only variables that 
send incorrect messages in the first iteration, it is impossible to encounter such a variable node without 
introducing a 4-cycle. Hence, this configuration converges to the correct codeword at the end of the first 
iteration. 

Case 2: Consider the error configuration shown in Figure (Hb). 
In the second half of the first iteration, we have: 

wi{c\,v) = -W, ve{vl,vl} 
wx(c,v) = -W, veV 2 , c£C l \c\ 
wi(c,v) = W, otherwise 

In the first half of the second iteration, according to Table Hill no —S messages can be sent by variables 
neither in V^F 1 because no — S message propagate in the first iteration, nor variables in V 1 because they 
all receive at least three W messages: 

u 2 (v,c) = -W, ve{vl,vl} 7 ceC l \c\ 

lo 2 (v,cI) = W, v£{vl,vl} 

lo 2 (vI,c) = W, ceC 1 

cj 2 (v,c) = -W, v e 7Vo(T 3 1 ), ceC 2 

lu 2 (v,c) = W, veA/o(T 2 2 ), ceC 2 
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lo 2 (v,c) = W, veAf (T^), ceC 1 
oj 2 (v,c) = S, otherwise 

In the second half of the second iteration, the messages going out of certain check nodes depend on the 
connection degree of these check nodes. However, we do not want that the proof be dependent on the 
degree of connection of check nodes. Hence, we consider in the following the "worst" case, that is the 
configuration where each message has the smallest possible value. In that case, the messages along the 
edges in the second half of the second iteration are such that: 

w 2 {c,v) = -W, v tV 2 nN 2 ({v{,v l 2 }), ceC^cl 
w 2 (cl,:) = W 
w 2 {c,-.\v) = -w, veM (Ti), ce^nM^ 1 ) 

W 2 (c,v) = W, V £ V 2 , C S {Cg, <4> Cg, C^s) 

vo 2 (c,:) = W, ce C 1 nMCTg 1 ) 
vo 2 (c,:) = W, ceC 2 nM(T|) 
w 2 {c,v) — S, otherwise 

At the end of the second iteration, all v E V 1 receive all correct messages W or 5*. According to Table 
HH all variables in V 1 are hence corrected at the end of the second iteration. For variables in V 2 , since 
no —S messages propagate in the second half of the second iteration, we see on Table HU that variables 
in V 2 , which are not received in error, are decoded as 1 if and only if they receive four — W messages. 
The following lemma prove that this is not possible. 

Lemma 4: No variable node receives four incorrect — W messages at the end of second iteration. 
Proof: Let v be such a variable. Then the four neighboring checks of v must belong to {c\, c\, c\, c\, Cg, c)}U 
(C 2 fl A/"i(T 3 1 )). Note that only two neighbors of v can belong to {c\, c\, c\, c\, Cg, c\} without introducing 
a 4-cycle. This implies that there are only three cases: 

• v has two neighboring checks, say and c 2 , in C 2 fl A/i(T 3 1 ), and two checks in {c}, c\, c\, c\, Cg, c\}. 
Let v\ and v\ be the T\ variables connected to c\ and c 2 ,. It results that the set of variables 
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{vl,vl,Vi,v%,v} is connected to only 11 checks, which contradicts the 5 — ^12 expansion condition. 
This case is hence not possible. 

• v has one neighbor in {c\, c\, c\, c\, c\, c\} and three neighbors in C 2 fl A/i(T 3 1 ), say c\, c 2 , and c 2 . 
Let v\, v\ and v 2 be the Tg 1 variables connected to c\, c| and c\. It results that the set of variables 
{v{, v\, v 2 , v%, v 2 , v} is connected to only 13 checks, which contradicts the 6— >14 expansion condition. 
This case is hence not possible. 

• v has four neighbors in C 2 fl A/^Tg 1 ), say c\, c|, c| and c|. Let uf, uf, and u| be the Tg 1 
variables connected to c\, cf, Cg and C4. It results that the set of variables {v\, v^, v\, v 2 , v 2 , f| , v\, v} 
is connected to only 15 checks, which contradicts the 8— >16 expansion condition. This case is hence 
not possible. 

■ 

Hence, the decoder converges at the end of the second iteration. 



Case 3: Consider the error configuration shown in Figure [He). In the first iteration, the variables 
1, 2 and 3 send incorrect — W messages to their neighboring checks. At the end of the first iteration, 
they receive correct messages from all their neighboring checks. There is no variable that receives four 
incorrect messages (as it will cause a four-cycle). Hence, the decoder successfully corrects the three errors. 



Case 5: Consider the error configuration shown in Figure [He). 
Neither Tg 1 nor variable can exist in V 2 because it would contradict the 4 — > 11 expansion condition. 
At the end of the first iteration, we have: 

w^cV 1 ) = W, ceC'Mclcl,^} 

^i{c,V r ) = -W, c£{c\,c\,c\} 

m^c-.XV 1 ) = W, CG {oleic}} 

m^c-.XV 1 ) = -W, ceC'Mclclc]} 
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w\(c, :) = W, otherwise 

Since a variable in V 2 has at most two connections to C 1 , these variables send S messages to check 
nodes in C 1 at the begining of the second iteration. Hence: 

u 2 (v,c) = -W, veV 1 , c&{c\,c\,c\} 
u a (v,c) = -S, veV\ cGC^icicl,^} 
oj 2 (v,c)=S, veV 2 , ceC 1 
u 2 (v, c)=W, v€ 7V (T|), c e CXC 1 
^2(v,c) = S, otherwise 

Hence, at the end of the second iteration, we have: 

w 2 (c,v) = -W, v € V 1 , c G {c\,c\,c\} 
zu 2 (c,v) = S, v e V 1 , c £ C\{c\,c\,(^} 
w 2 {c,v) = -S, veV\V\ ceC^iclclc^} 
m 2 (c,v) = W, v<EV\V\ ce{c\,c\,c\} 
w 2 {c,:) = W, c e Af^T-DXC 1 
w 2 (c,:) = S, otherwise 

Hence, at the end of the second iteration, a variable in V 2 receives only W or S messages from check 
nodes in C 2 . It therefore sends S messages to check nodes in C 1 at the begining of the third iteration. 
As it is used in the sequel, let us mention more explicitly that a pair (v, c) £ A/o(T|) x C 2 is such that 
Ni{(Ni{v) n C 2 )\{c}) n A/" (T|) = {v} means that the variable v is in A/" (T 2 2 ) and the check node which 
is (Afi(v) n C 2 )\{c} has no other neighbor in A/" (T 2 2 ) except v. As well, a pair (v, c) £ A/" (T 2 2 ) x C 2 is 
such that ((M((M(«) n C 2 )\{c})) n N (T%))\{v} ^ means that the variable v is in J\f (T$) and the 
check node which is (Mi(v) PI C 2 )\{c} has another neighbor in M (T 2 ) different of v. We thus have at 
the begining of the third iteration: 

ws(v,c) = W, veV\ ce{c},44} 
ua(v,c) = -S, veV\ ceC 1 ^,^} 
wa(v,c) = S, veV 2 , ceC 1 
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wa(v,c) = W, (v,c)&Nq(T%)xC 2 
such that M((M(«) n C* 2 )\{c}) n 7V (T 2 2 ) = {v} 

cj 3 (u,c) = -W, (u, c) 6 No(T$) x C 2 
such that ((M((M(«) n C 2 )\{c})) n AA (T 2 ))\{ V } ^ 

W3(w,c) = 5, otherwise 

It comes that at the end of the third iteration, for variables in V 1 we have: 

w 3 (c,v) = W, veV\ ce{c\,cl,c\} 
vj 2 {c,v) = S, v e V 1 , ceC^icl^cl.c)} 

(4) 

Hence, according to Table HH all the variable nodes in V 1 are corrected. For messages going into variables 
not in V 1 , we have: 

w 3 (c,v) = -S, v e V 2 , ce C^ic^cl,^} 
w 3 (c,v) = W, v e V 2 , c £ {c{,c\,cl} 
w 3 {c,v) = W, (v,c) such that c 6 C 2 

and there is an even number of v' in A/"i(c) n No(T 2 )\{v} such that 

((AfimW) n c 2 )\{c}))nUo(T 2 ))\{v'} jt 

ro 3 (c, u) = — W 7 , (u, c) such that c e C 2 
and there is an odd number of v' in M(c) n7V (T 2 2 )\{u} such that 

((A/i((M(«0 n c 2 )\{c})) n^ (T 2 2 ))\K} ^ 

073(0, v) = S, otherwise 

Lemma 5: There is no decision error on all variables not in V 1 at the end of the third iteration. 
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Proof: According to Table HH we have to show that the following four situations can not happen: 

• Any variable not in V 1 cannot receive more than three —S messages. Indeed, it would imply that 
the variable has at least three connections to C 1 \{cj;, c\, c\}, which would contradict the 4 — > 11 
expansion condition. 

• If any variable, say v, not in V 1 would receive two — S messages and at least one — W mes- 
sage, it would imply that it has two connections to C 1 \{c];, c\, c}} and one connection to a check 
node c such that c E C 2 and there is an odd number of v' in jVi(c) fl A/o(T , 2 2 )\{ v } sucn mat 
((Mi((Mi(v') n C 2 )\{c})) D J\f (T$))\{v'} ^ 0. Let v" denote the variable of such a non-empty set. 
Then {v\, v^, vl, v, v', v"} is connected to only 13 check nodes, contradicting the 6 — > 14 expansion 
condition. 

• For sake of clarity, let us now use figures. Without loss of generality, Figures |3£a) and [3£b) illustrate 
the configurations when the variable v receives, at the end of the third iteration, one — S message 
and three — W messages, and when it receives one — S message, two — W messages and one W 
message, respectively. These configurations are not possible as they contradict the 9 — > 18 expansion 
condition. 

• Without loss of generality, Figure (3£c) illustrates the configurations when the variable v receives four 
— W messages at the end of the third iteration. This configuration is not possible as it contradicts 
the 8 — > 16 expansion condition. 

■ 

Hence, the decoder converges to the valid codeword at most at the end of the third iteration. This completes 
the Proof. 

■ 

Proof of necessity: 
Necessity of the 4 — ► 11 condition 
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Consider the subgraph shown in Figure (3]^d). In this case, the 4 — >• 11 condition is not satisfied. It is easy 
to see that, even though we assume that only S messages are propagated from the check nodes which 
have an odd degree in the subgraph, to the four variables, the errors are not corrected at the end of the 
third iteration. 

Necessity of the 5 — ^12 condition 
As mentioned in |[T8l , there exists no graph of girth six which satisfies the 4 — ► 11 condition but does 
not satisfy the 5 — > 12 condition. 

Necessity of the 6 — > 14 condition 

Consider the graph shown in Figure He). This graph satisfies the 4 — > 11 and 5 — ^ 12 conditions but not 
the 6 — > 14 condition. This graph correspond to the analysis performed above for Case 5. With message 
values described in this above analysis, it is easy to see that the variables in V 2 are wrongly decided to 
1 at the end of the third iteration. Hence, in order to guarantee the correction of three errors in three 
iterations, the 6 — > 14 condition must be satisfied. 

Necessity of the 8 — ^16 condition 

Consider the graph shown in Figure H£c). This graph satisfies the 4 — > 11, 5 — ► 12 and 6 — > 14 conditions 
but not the 8 — > 16 condition. With message values described in the above analysis of Case 5, it is easy 
to see that v is wrongly decided to 1 at the end of the third iteration. Hence, in order to guarantee the 
correction of three errors in three iterations, the 8 — > 16 condition must be satisfied. 

Necessity of the 9 — ^18 condition 
Consider the graph shown in Figure Kb). This graph satisfies the 4 — > 11, 5 — > 12, 6 — > 14 and 8 — ^16 
conditions but not the 9 — > 18. With message values described in the above analysis of Case 5, it is easy 
to see that the variables in V 2 are wrongly decided to 1 at the end of the third iteration. Hence, in order 
to guarantee the correction of three errors in three iterations, the 9 — ► 18 condition must be satisfied. 
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(e) Case 5 

Fig. 1. All possible subgraphs subtended by three erroneous variable nodes. 
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Fig. 2. FER versus the crossover probability a for regular column-weight-four MacKay code. The code rate is 0.89 and the code length 
is n = 1998. 
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Fig. 3. 
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TABLE I 

Examples of message update for a column-weight-four code, when C = 2, S = 2 and W = 1. 



# incoming — S messages 


2 


1 





1 


# incoming — W messages 





1 


2 





# incoming messages 


1 








1 


# incoming S* messages 





1 


1 


1 


Rv 


-c 


c 


c 


-C 


Uj(v,c) 


-s 


w 


s 


-w 
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TABLE II 

Decision rule: Number of messages — S, —W, W and S going into a variable, when this variable node is decoded as 

(RESP. 1) WHEN THE CHANNEL OBSERVATION IS 1 (RESP. 0). THE CODE HAS COLUMN WEIGHT FOUR AND THE TWO-BIT DECODER HAS 

(C,S,W) = (2,2,1). 





# -s 


# -w 


# w 


# s 




mess. 


mess. 


mess. 


mess. 













4 










1 


3 










2 


2 


Received value 1 








3 


1 


Decoded as 








4 
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3 
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1 


2 
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1 
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3 
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2 
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1 


2 


1 







1 


3 








Received value 


2 


1 





1 


Decoded as 1 


2 


1 


1 







2 


2 










3 








1 




3 





1 







3 


1 










4 
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TABLE III 

Update rule: Number of messages — S, — W, W and S going into the variable node v leading to different values of 

THE MESSAGE Wj («, c) GOING OUT OF V, WHEN THE RECEIVED VALUE IS r v . THE CODE HAS COLUMN WEIGHT FOUR AND THE TWO-BIT 

DECODER HAS (C, S, W) = (2, 2, 1). 





# -s 


# -w 


# w 


# s 




mess. 


mess. 


mess. 


mess. 


r v = 1 








2 


1 


uJj(v, c) = W 








3 










1 





2 


r v = 1 











3 


Wj(w,c) = 5 








1 


2 


r„ =0 


2 


1 








Wj(«,c) = -5 


3 
















3 








r„=0 


1 


2 








OJj(7J, C) = — W 


2 





1 










2 





1 







2 


1 










3 










1 





2 







1 


1 





1 


r„ = 1 


1 


1 


1 





Wj(«,c) = -5 


1 


2 










2 








1 




2 





1 







2 


1 










3 
















1 


1 


1 


r« = 1 





1 


2 





c) = — W 


1 








2 




1 





1 


1 







2 


1 





r v =0 


1 


1 





1 


uJj(v, c) = W 


1 


1 


1 







2 








1 













3 










1 


2 










2 


1 










3 





r v =0 





1 





2 


uJj(v,c) = S 





1 


1 


1 







1 


2 










2 





1 




1 








2 




1 





1 


1 




1 





2 






Thresholds of different 



TABLE IV 

DECODERS FOR COLUMN-WEIGHT-FOUR CODES WITH ROW DEGREE 



p 


Rate 


A 


r> 




(\ 1 1 \ 
(1,1,1) 


8 


0.5 


0.0474 


0.0516 


0.0583 


0.0467 


16 


0.75 


0.0175 


0.0175 


0.0240 


0.0175 


nrj 


U.o/o 


U.UUOOO 


U.UUOOO 


A AAAQ£ 

u.uuyoo 


A AA£ C £ 
U.UUOOO 


P 


Rate 


I 1 ! 2, 1J 


CI Q 1 \ 
I 1 ! 3, 1) 




ft 1 A 


8 


0.5 


0.0509 


0.0552 


0.0552 


0.0467 


16 


0.75 


0.0165 


0.0175 


0.0175 


0.0175 


QO 
OZ 


A five: 


U.UUOOz 


A AA/1 Oft 

U.UU4O0 


A AA/1 Of? 

U.UU4O0 


U.UUOoO 


P 


Rate 


(2,2,1) 


(2,3,1) 


(2,4,1) 


(3,2,1) 


8 


0.5 


0.0567 


0.0532 


0.0552 


0.0467 


16 


a 

U. (0 


A A1 *7*7 
0.U1 I ( 


A A1 CO 
U.UlOO 


A A1 7C 
U.U1 (0 


A AOI O 

0.U218 


32 


0.875 


0.00587 


0.00568 


0.00486 


0.00921 


P 


Rate 


(3,3,1) 


(3,4,1) 


(4,3,1) 


(4,4,1) 


o 
o 


0.0 


U.U6of 


A AftOA 

U.UozU 


AA/1 Oft 

U.U480 


0.060/ 


16 


0.75 


0.0222 


0.0203 


0.0227 


0.0222 


32 


0.875 


0.00755 


0.00691 


0.00871 


0.00755 


P 


Rate 


Dynamic two-bit 

decoder with 
S = 2 and W = 1 








8 


0.5 


0.0638 








16 


0.75 


0.0249 








32 


0.875 


0.00953 









